


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations 1. Thesis and Dissertation Collection, all items 


1971-03 


Investigation of a fit of beta and normal 
distributions to a product of beta distribution. 


Foard, John Stager Jr. 


Monterey, California ; Naval Postgraduate School 
http://ndl.handle.net/10945/15773 


This publication is a work of the U.S. Government as defined in Title 17, United 
States Code, Section 101. Copyright protection is not available for this work in the 
United States. 


Downloaded from NPS Archive: Calhoun 


Calhoun is the Naval Postgraduate School's public access digital repository for 
| (8 D U DLEY research materials and institutional publications created by the NPS community. 
«ist sia Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS's first 


NY KNOX appointed — and published -- scholarly author. 

ia) LIBRARY Dudley Knox Library / Naval Postgraduate School 

411 Dyer Road / 1 University Circle 
Monterey, California USA 93943 





http://www.nps.edu/library 





INVESTIGATION OF FIT OF BETA AND NORMAL 
DISTRIBUTIONS TO A PRODUCT OF BETA 
DISTRIBUTION 


by 


John Stager Foard 














United States | 
Naval Postgraduate Schoo! 





INVESTIGATION OF FIT OF BETA AND NORMAL 


DISTRIBUTIONS TO A PRODUCT OF BETA DISTRIBUTION 


by 
Johiteotaser Foard, -Jn- 


Dhesas Ney rsion- | W. M. Woods 


March 1971 


Approved fon public rclease; distribution unlimcted. 


Tti2gnoo 





Investigation of Fit of Beta and Normal 


Distribtitions to 2 Product of Beta, Ui1stribmenons 


by 


John Stager Foard, Jr. 
Lieutenant, United States Navy 
B.S., Unated States Naval Academy, 1965 


Submitted in partial fulfillment of the 
requimeienMtsut or Ene degree Od 


MASTER OF SCIENCE IN OPERATIONS RESEARCH 


from the 


NAVAL POSTGRADUATE SCHOOL 
March 1971 





‘ 


BY , 


POSTGRADUATE SCHOOL 
o jin a ° 94 O 


ABSTRACT 


Excessive costs prohibit the Department of Defense and 
industry from testing entire systems to obtain estimates of 
system reliability. Thus, individual component tests must 
be combined in such a way as to yield an accurate estimate 
of the system reliability. 

Assuming each component reliability to have a prior 
distribution which is beta distributed, Bayesian techniques 
mestilt in the posterior distributions also being beta dis= 
tributed. The system reliability for a series system would 
Bicep ee Lic produGumoaetile pPOSLerIonr diS€ributions. 

Computer simulation techniques were used to determine 
the system reliability distribution for a series system of 
beta distributed components. Method of Moments techniques 
were then used to fit beta and normal distributions to the 
system distribution. The twentieth percentile points of 
the fitted and the actual distributions were then compared 
aS a measure of accuracy of the fit. 

ihe fitsof the beta distribution preved to be aceurace 
for all parameter ranges and number of components in each 
meotem. tthe fit of the normal distribution was accurate 


only when used with limited parameter values. 
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I. INTRODUCTION AND SUMMARY 


he. INTRODUCTION 

The purpose of this study was to analyze the accuracy 
of fitting a product of beta distributions with beta and 
with normal distributions using computer simulation tech- 
mraues. If successful, a normal or beta distribution could 
be used to fit the posterior distributions in Bayesian 
techniques to the reliability of a series system where the 


component prior distributions are also beta distributed. 


Be MEASURE OF ACCURACY 

The Bayesian 100(1l-a)% lower confidence limit for the 
System reliability, Ro; is the 100 ath percentile point of 
the distribution of R,. Therefore, the difference between 
the 100 ath percentile points of the actual and the fitted 
distributions was selected as a measure of the accuracy of 


the fit. 


C. ‘SUMMARY OF RESULTS 

When the method of moments technique was used to fit a 
normal distribution to the distribution of the reliability 
of a series system, the fit was accurate for a limited num- 
ber of cases. The data depicted in Table III indicates 
mat the normal distribution fit can offer a simple and ac- 
curate method of estimating the system reliability. 

When the constraints of the fitted normal cannot be 


met or if an easy method of obtaining a percentile point 








of a beta distribution is available, the beta fit should be 


used. 








eee eee ROD eM 


A. BACKGROUND 

Due to the costliness of mission testing entire sys- 
tems, the Department of Defense must rely on individual 
component tests to estimate system reliability. Among 
Geher things, the accuracy of this estimate is dependent 
Boom, Chel: O01 -decopeeis1c distribution to actual distri- 
butions. It is often necessary due to mathematical and/or 
Statistical complications to assume a distribution which 
only approximates the actual distribution. A secondary 
yet important consideration is the manner in which the com- 
Mememt test data 1s Utilized in determining the estimatred 
eystem reliability. 

Bayesian techniques offer an acceptable solution to 
the test data utilization. In Bayesian analysis, the beta 
distribution with parameters a and b is usually choosen as 
thie prior distribution for component reliability. The pa- 
rameters a and b relate to attribute type data. A problem 
arises when trying to combine the component beta distribu- 
mons to get a confidence interval on system reliability. 
In particular, the prob tem exists on how to construct methods 
for estimating the system reliability when each of the com- 


ponent reliabilities is assumed to be beta distributed. 


B. BETA DISTRIBUTION AND BAYESIAN TECHNIQUES 
le beta nis taloine Ons 
The beta distribution with parameters a and b has 


Vic muOmlowine sprobabilaty Lunetion: 
q 








BiGo) = rrSSTLy Foleo a) 50. 


The mean, uw, and variance, o*, are computed by the following 


formulae: 





all 


she (atb)  (atb+l) 


Z. bayesian Mecanvgues 


The usefulmess of beta prior distripurvoncmand 
Bayesian techniques can be depicted by the following example. 
Suppose n components of one type are mission tested and 
further suppose each component is beta distributed, 86(x;a,b). 
mee Ss be the number of Components which do not fail] | ihe 
myO(1-a)% lower Bayesian confidence limit on component reli- 


bility is the solution for P in the equation 


B(X7a*s-atptmac Hl )dx, 


Q 
I 
os 


that is, the posterior distribution of component reliability 
is B(x;ats,btn-s). Thus, by the use of beta distributions 
and Bayesian techniques, both past and present test data can 


meadily utilized in réliability calculations. 











III. SOLUTION 


A. ACTUAL SYSTEM DISTRIBUTION 

The actual system distribution to which the beta and 
normal distributions were fitted was generated on the IBM 
360 Computer at the United States Naval Postgraduate School, 
Monterey, California. The main program was used with slight 
modifications to evaluate the 100ath percentile points of 
the fitted beta distributions. The required subroutines 
were a eaied from the Computer Center Library. 

1. Main Program 

The main program was constructed to randomly gen- 

erate a reliability value for each component of the series 
systems. Assuming the component distributions to be inde- 
pendent, the system reliability, Re» would then be the pro- 


K 
duct of the component reliabilities, R55 pe Sis Ree Ree 


1 
Thus, by multiplying the generated component reliability 
values, a value of the system reliability was obtained. 
This process was repeated to obtain 500 values of Ro The 
values were ordered to obtain a simulated distribution of 
R.- The one hundredeth number of this distribution was then 
assumed to be the twentieth percentile point of the actual 
mascem relaability distriputiom, 
Be sl ieones Ves: 
The Subroutine BDTR was used to obtain values of 


the cumulative distribution fumetion of the bete distrioucroen.. 


ihe subroutine 1s Contained in Rk. E. Baremann and S. PP. Ghocm 








Statistical Distribution Py poeeanse+o ned Computer Language, 
I.B.M. Research Report RG-1094. lt has a maximum eCrienuee: 
ia for values of a and b between 0.5 and 10°. Subroutine 
BDTR used subroutine NDTR, CDTR, and DLGAM in its .computa- 


tions. 


5: METHOD OF MOMENTS BETA FIT 


Te Ssupposit BOs eit iva tame items ) cule ee Tpc unde nel eles ta a Ro» 1s 


beta distributed with parameters A and B where R.=,1, R, 


and the R's are beta distributed with parameters as and b; 


mespectively. Using the method of moments technique, the 


Z 


mean, wu, and variance, o*, of the system distribution are 


as, tLollows: 





K 
Wy ECR) > yay ECR 
A K nates! 
= ASR agitl (@eep.) Caleb 
1 1 aL 1 


o? = caeByZ(APBeIy * ECR)? - [E(R,)J? 


In addition, 


A(At+1) K a; (a,+1) 
E(R c) = = .T 
S (A+B) (A+B+1) 1=1 a.t+b. a.+tb.+1l 
1 Sk i oi 
etting 
K a. 
_ i 
Sewer 
et ok 
and 


K a.(a,+1) 


2s ee ee 
He i=l (a,+b.)(a,+b,+1) 
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A and B can be determined: 


A = Ciine ion asa 
2s es 


B = Sina 
Woe Mae 


Subroutine BDTR was then used to determine the twentieth 


Perecenttle pOInceo: the betavdis tEIpuU td one won epi ewme acm. 


and B as calculated. 


c. METHOD OF MOMENTS NORMAL FIT 
Define Q,=1-R, and assume Re 1S Weber 3 4 Q. is a beta 


distributed random variable with parameters b. and a.. R. 


K 
is equal to ,2,0-Q,). Since Q. ise small” Vexpanaume 
K 
=, Geren 
PR .= /1,Q;- The supposition is now that 1-R, is normally 


,2, 1-9.) and neglect tiles CEOsSsme produc Es. Ro=1 


distributed, with parameter uw and o% since it is a sum of 


random variables. Using method of moments techniques, 


I= 
II 


K K s b; 
BCL-RoJTEC Hy Qy= 4H) BCQIA Hy a7; 
and 

K K 
var(1-R,)=var(.0, Q,)=.0) var(Q,) 


ae ,5; 
~ 7s Ly (a; nD 7 (a; +d. radlyee 


lie) Eweneieth percentile point of Re is the same as the 
Peon ite tin pe recmmmnc point on 1-R.. The eightieth percentile 
pPowmnt Ot 1-R. Ss Or gt where Z 9 1s the cCiehtieth perceneme 


point of the Standard Normal Distribution. 


ii 








IV. RESULTS 


A. ACTUAL SYSTEM DISTRIBUTION 

The actual system distributions were generated for 
series systems of fifteen and twenty-five components using 
the nineteen sets of parameters as listed in the first 
three tables. It was assumed that all components in the 
systems would have the same parameter values. The twentieth 
merecntile points of these distributions are listed in 
Tables I and II. 

Bue Coethe number of 1uns  reaquiied and tomtines lowe: 
of computer time required to call subroutine BDTR, the num- 
ber of samples forming these distributions was limited to 
five hundred. This limitation resulted in the possible 
Warlance of the twentieth percentile point of a given dis- 
tribution by as much as .003 when a different series of ran- 
dom numbers were used to generate the same distribution. 
Variations of this amount would make a significant change 
miecolumn five of Tables I and Jil. For example, usime 
a=1000.0 and b=5.0 in Table I, the difference between the 
metlaletwentieth pencentile point and the fitted beta point 
was oniky .002. Yet, ae difference resulted in an error 


of 4.6 percentage points (20.0-15.4=4.6). 


B. METHOD OF MOMENTS BETA FIT 
Using the formulae developed previously to obtain the 
system parameters A and B, the twentieth percentile point 


of the system distribution was calculated by computer using 


Ih 4 








« 


subroutine BDTR. Considering the maximum error of BDTR, 
the data of column four in Tables I and II should be more 
accurate sthan  thateomsehe ac cua dS ei Diam 

Examination of columns three and four of Tables I and 
II shows that the beta fitted distribution provides a more 
accurate estimate of the actual distribution for the system 
Sup twenty-Live components than for the fifteen ss However, 
even for the smaller system, the method does result in rea- 
sonably accurate estimates of the twentieth percentile point 
particularly if a variance of .003 ie introduced into the 
actual distribution percentile point. It is interesting to 
mote that the method appears to be about the same degree ac- 
curate throughout the parameter ranges for both systems. 
Due to the steepness of the curves involved, the small per- 
centage error figuresvean be misleading. The actualmper— 
Sentile points (column five) might offer a better measure 
Sreaccuracy. These points indicate that in most of the 
cases the error is conservative and that the approximation 
actually represents the lower limit of a higher degree of 


Sentidence than Gighty percent. 


c.. METHOD OF MOMENTS NORMAL FIT 

Uresuesultswor the normaletuteane sdepretedsin es lanic 
III. As can readily be seen in this table, the normal fit 
isnot accurace when the ratio of a to b is tess than 500 
to 1. Since these parameters can be related to the number 
of failures and number of successes, these results tend to 


prove the initial assumption made when deriving this method. 


13 





This assumption was that Rs was “large. The resultsein- 
dicate that "large" means one or less failures out of 500 
mission tested components. Given these parameter con- 
straints, the normal fit is quite accurate. Due to the 
limited range of parameters, this method was not investi- 


gated further. 


IONE BETA FIT WITH VARIOUS PARAMETERS 

Tne process OL fittines the be tamdms Chi otle 1 omeeEO mam 
system reliability was successful enough to investigate the 
accuracy of the method when the components have different 
peamaneter Valuesses lable {VV deprerps these nesul ts mune 
comparison was made for systems of fifteen and twenty-five 
components and for two different general parameter ranges. 
The limitations of computer core suggested that no more 
than five different distributions be used. Thus, in the 
fifteen component system, there are three components with 
each set of parameters; and in the twenty-five component sys- 
Heme there are five components with Gach set of parameters. 

The results indicate that the method of moment fitted 
beta distribution is equally accurate when there are mixed 


distributions in the systems. 
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TABLE 


This table lists the results of the method of momenes 
beta fit and the actual distribution for a series system of 
fifteen components. All distributions in the system have 
the same parameters. Columns one and two list the a and b 
manameters respectively. Column three vis the twentreun 
percentile point of the actual distribution. Column foun 
moethne twentieth percentile point of the beta fitted dis; 
tribution. Column five lists the percentile point of the 
metual distribution that the number am column four represents: 
Selumn SixX is the percent error which is the difference be- 


tween column three and column four divided by column three. 


a b Actual Be bag eae ACE. Ieee 1% 
HO50 0.5 Os Z Oies 702 Z0r0 0.0 
ioe, 1.0 0.168 Dos IBS 8s a0 
30.0 Ves OR7G6 ew 4.4 58, 
e070 861.0 0.545 0.547 20.8 Nee 
B10. 0 6510 OS ira: Or 2 5 17.4 ae 
moe 0.5 VE OE 0.824 19.4 0.1 
(0) 75 ie is 0 0.700 0.696 IBS «8 06 
mos0 882.0 YESS: 0.505 Wools 4.5 

mO.0 860.5 Oe LS 0.908 16.4 0.6 
roo O 861.0 07-859 0.834 L 70 0.6 
100.0 2M 0 700 Ore0o 16.4 Le 
s00.0 Coe 0.981 02951 20.1 Caw 
900.0 dra0 UES 0.964 Pas 0:50 
so0.0 2.0 0295 Oraoro'S 1 rae Des 
s00.0  §.0 0.850 0.849 17.4 Orr 
moo0.0 0.5 OE Shoe, ooo 0 75.0) 6 Ih 0.0 
m00.0 1.0 O95 Oro IN OG, Oro 
1000.0 2210 he Ne) fe GF 06 If 58 0.0 
roooO.0 65.0 O25 ga 15.4 On 
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TABLE Ii 


This table lists the results of the method of moments 
beta fit. and the actual distributions tor 4a series system 
ong twenty-five components. PALL drystribucions Ieee w sy oe 
tem have the same parameters. Columns one and two list the 
a and b parameters respectively. Column three is the twen- 
mich pereentile poimt Of the actual GistripuGcron. seco ulnm 
MOU lSeune tWwenkicth percenmmslewpomt ecieethne Do tamaemmncd 
distribution. Column five lists the PerTeeh Gi ee Delmon 
the actual distribution that the number in column four 
mepresents. Column six 1S the percent error whieh is. the 


G@itterence between columns three and four divided by column 


three. 
a b Retual Beta Fit Act. 3 Error 
Oo. 0.5 0.205 OZ 20.8 0.8 
HO. 1.0 C2055 0.054 19.4 1.8 
50-0 0.5 0.650 0.597 2.6 Saaz 
30.0 1.0 0.379 0.379 20.0 Grad 
S020) 2.0 0.160 0.160 20 zt 0.0 
S020 0.5 CUR acy O27 SS 20.8 O%-5 
50.0 1.0 0.560 0.559 19.6 0.2 
S00 2.0 CLs Biss 0.331 520 72.5 
100.0 O.5 0.860 epersh Ss) V/ LS 0.3 
mogeo 1.0 Oe 747 0.747 20.0 @) 10 
100.0 2.0 02575 Oas74 L924 0.2 
s00.0 0.5 0.970 0.970 ZO rES O20 
500.0 1.0 0.944 0.944 19.6 0.0 
500.0 2.0 0.897 0.894 1 0.3 
S00.0 5.0 0.765 0.765 WME 0.0 
Hoood.0 0.5 0.985 0.985 Zi 0.0 
moog .0 1.0 0.971 0.971 19.0 0.0 
Hood .0 2.0 0.945 0.946 20.8 Oat 
oO 5.0 0.875 267s 18.0 0.0 
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TAREE Sr 


This table lists the results of the method of moments 
normal fit and the actual distribution for a seriés system 
of twenty-five components. All distributions in the system 
have the same parameters. Columns one and two list the a 
and b parameters respectively. Column three is the twen- 
meth percentile point of the actual distribution. Column 
four is the twentieth percentile point using the techniques 


described previously. 


a b Actual Normal Fit 
10.0 es Ore20i5 - 0.454 
1) [0 ee) 0.055 SasleO)2 
0) (0 G58 0.650 0.49 
30.0 La Oso 0.062 
AY lt 2 oll 0.160 = Oe 
50.0 Oe O77 a5 0.694 
SU eo) O00) 0.429 
Bie 4 oll) O273'58 8) i 

1G 0 ae 0.860 0.846 
100.0 0) 0.747 Og lial 
LOO S8 Zr) O57 5 0452 
500.0 oO) oes Oe 0 0.969 
500.0 IL <0 0.944 0.942 
SW ye MOy O82 / 0.888 
500.0 ao Ue VOs 0.734 
1000.0 ORS 0.985 0.984 
1000.0 0 Uae Val fees) (1! 
1000.0 Soll) Oe ens 0.944 
1000.0 5.0 0.875 0. 866 


iy, 








TABRE IY 


This table lists the results for method of moments beta 
fit using different parameters in the component distributions. 
Columns one and two are a and b parameters used. Column 
three is the number of components in the system. Five dif- 
memeclt Sets OL Paranmeuers avrewiscd=an In wane fitteen compe 
mene Syseem, there are three components with the same seuror 
parameters. In the twenty-five component system, there are 
five components with the same set of parameters. Column 
four is the twentieth percentile point of the actual distri- 
mieion. Column five is the twentieth percentile point of 


mene fitted beta distribution. 


a b k Actual Beit dh uaige 
50.0 Nes 
OO 0 Os iS OS 8374 72 Oo 210) 
100.0 ae 
OOO 2.0 25 OR SS. OR 2s 
500.0 5.0 
SUR ihe 0 
500.0 Za 15 0.966 De sare 
1000.0 Ors 
1000.0 1010 Zs 0.946 0.947 
1000.0 200 
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TABLE V 


Using thre me chodiot enoOmemese Dice dma. R. was assumed to 
be beta distributed with parameters A and B. This. table 
lists the parameters A and B for the various numbers of sys- 
tem components and component parameters a and b. Columns 
He aha uvo aneuule do and b Pdrameters respectively. Col. 
umns three and six are the number of components in the sys- 
tem. Columns four and five are the A and B values for the 
variables of columns one, two, and three. Columns seven 
and eight are the A and B values for the variables of col- 


umns one, two, and six. 


la 2.6 3.k 4A SB  6.K 7A  8.B 
moO.0 0.5 IS eae eS 25 O49 Ar 0 
mo 0 1.0 i cae. less 25 Bae 5/26 
EO 0. 5 ILS 26.8 as: 25 Zens 1 2 
SO 1.0 is 2a 1 IS eo ZS Z0z 6 26.4 
S076» Z. 0 JUS 19.8 S26 25 f Sees 61.4 
BO 20 025 Jes AG 27 (as 25 Aas 12.6 
Ole. 0 15 AL fi jhe ee | 6 § 39.8 iiac res 
B0.0 ~2.0 15 56.5 30.9 25 See 5455-0 
OO 50 0.5 Is 96.6 Vhres. ZS 94.3 es 
LOO.G 1.0 eS O35 15.0 ZS 88.9 (eal 
00.0 2.0 JS) oy at! S022 ZS 79.6 see 8, 
poO0.0 O.5 15 500.7 7.6 5, 5. 498.9 IDA 
S0O.0: 1.0 15 490.7 14.9 ao 485.4 24.9 
BOO.0 862.0 Ws 485.9 30.0 aS 476.1 50.0 
BOO.0 5.0 ILS 465.3 74.9 2S 443.4 i Aes era 
HOOC0.G 0.5 IS: 1029.9 Tie pas 1046.6 WS 7 
1000.0 1.0 eS 976.0 Arey 25 969.2 Zs 
1000.0 2.0 15 993.8 SO 25 981.4 5 Ores 
HOO00.0° 065.0 Jiggs: 966.8 ace t 25 942.9 los 
oy Ue ie 3 5 
HOO! 202 950:.5 5 5 
LCRURANG! | Jak 16) 3 89.98 16.03 2 Se Bea 70279 
OO 02. 0 & 5 
BOO Om 5.0 3 S 
S00c0”~ 120 3 2 
S00eG 2.0 3 5 
LO0G.G>. 0.5 3 57 Gn 0 Be LOno9 5 Sion (ons: ZOeo7 
1000.0 1.0 3 5 
1000.0 2.0 3 b) 


JUS) 





MAIN PROGRAM FOR FIVE DIFFERENT COMPONENT TYPES 
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